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We make use of information provided in the titles and abstracts of over half a million publications that were 
published by the American Physical Society during the past 119 years. By identifying all unique words and 
phrases and determining their monthly usage patterns, we obtain quantifiable insights into the trends of 
physics discovery from the end of the 19th century to today. We show that the magnitudes of upward and 
downward trends yield heavy- tailed distributions, and that their emergence is due to the Matthew effect. 
This indicates that both the rise and fall of scientific paradigms is driven by robust principles of 
self-organization. Data also confirm that periods of war decelerate scientific progress, and that the later is 
very much subject to globalisation. 



T 



he 20th century is often referred to as the century of physics 1 . From x-rays to the semiconductor industry, the 
human society today would be very different were it not for the progress made in physics laboratories around 
the World. And while amid the economic woes the budget for science is being cut down relentlessly 2 ' 3 , it 
seems now more than ever the need is there to remind the policy makers of this fact. Although to the layman the 
progress made on an individual level may appear to be puny and even needless, the history teaches us that 
collectively the physics definitively delivers. It is therefore of interest to understand how the progress made so far 
came to be, and how to best maintain it in the future. Should there be overarching authorities that dictate which 
scientific challenges to address and prioritise, or should we rely on the spontaneous emergence of progress? 

We know, for example, that the acquisition of citations 4 as well as the acquisition of collaborators 5 are subject to 
preferential attachment. These two processes are neither regulated nor imposed. They are perpetuated by 
scientific excellence and individual choice. In fact, Barabasi and Albert 6 have shown that preferential attachment 
and growth give rise to robust principles of self- organization that culminate in the emergence of scaling. 
Preferential attachment can be considered synonymous to the Matthew effect, which sociologist Robert K. 
Merton 7 coined based on the writings in the Gospel of St. Matthew for explaining discrepancies in recognition 
received by eminent scientists and unknown researchers for similar work. Derek J. de Solla Price 8 observed the 
same phenomenon when studying the network of citations between scientific papers, and most recently also the 
longevity of careers has been found driven by the Matthew effect 9 . 

Motivated by the existing reports of the Matthew effect in science, we explore whether the trends of scientific 
discovery are also subject to the same principles of self- organization. We make use of the titles and abstracts of 
over half a million publications of the Physical Review that were published between July 1893 and October 2012, 
and we infer the trends by adopting the methodology of culturomics 10 . Our approach is thus purely data-driven 11 , 
in line with substantial interdisciplinary research efforts that are currently aimed at obtaining quantitative 
insights into the social and natural sciences in general 1213 , but also into sports 14 , drug discovery 1516 , finance 17 , 
and scientific production 18 " 20 in particular. 

Results 

The timeline of publications for different journals and overall is presented in Fig. 1. It can be observed that the 
overall output (bottom most colour stripe) increases steadily over time. An obvious exception is the World War II 
period, during which the production dropped almost an order of magnitude, from nearly 100 publications per 
month before and after the war to below 10 during the war. This confirms, not surprisingly, that periods of war 
decelerate scientific progress or at least very much hinder the dissemination of new knowledge. 

By geocoding the affiliations, it is also possible to infer where the physics published in the Physical Review has 
been coming from. As can be inferred from Fig. 2 and the accompanying video, the formative years of Physical 
Review were dominated by the US, with relatively rare contributions coming from the UK, Germany, France and 
India. During the World Wars I and II large contingents of the World went silent (see the video referred to in the 
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Figure 1 | Publishing timeline of the Physical Review. Colour encodes the number of publications per month for each particular journal (the colour 
scale is logarithmic). Bottom most row depicts the overall output, corresponding to the sum of publications across all the journals. Volume 1, Issue 1 of 
Physical Review (Series I) (PRI) was published in July 1893. It consisted of five articles and two notes. Today the overall output hovers comfortably over 
1600 publications per month, with the maximum being reach in June 2012, with 1870 publications. Physical Review B (PRB) has the largest number of 
publications per month, the record being 772 publications during July 2005. It can also be observed when certain journals where retired or introduced. 
Abbreviations of journal names are those commonly used by the American Physical Society. 



caption of Fig. 2), and it was only during the 1950s and 60s that the 
US centrism begun fading. The collapse of the Soviet Union, the fall 
of the Berlin Wall, and the related changes in World order during the 
1980s and 90s contributed significantly to the globalisation, so that 



today countries like China, Russia, Canada, Japan, Australia, as well 
as large regions of Europe and South America all contribute mark- 
edly to physics research that is published in the Physical Review. 
Countries that are still exempt are from Central Africa and Sahara. 
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Figure 2 | Countries that contribute to research that is published in the Physical Review. Colour encodes the average monthly productivity of a country 
during each displayed year, as evidenced by the affiliations, normalized by the average monthly output of the US during 2011 (equalling ~ 565 
publications per month - a maximum). All affiliations were used, and in case more than one country was involved on a given publication, all 
received equal credit. A 12 month moving average was applied prior to calculating the average monthly production for each country. Note that the 
colour scale is logarithmic. Displayed are World maps for four representative years, while the full geographical timeline can be viewed at 
youtube.com/watch?v=OXeysi-EfZs. We have used publicly available resources (wikipedia.org and maps.google.com) to geocode the affiliations at the 
country level, as well as to disambiguate them in case of name variations, typos or name changes during the time period of study. Maps were produced 
with matplotlib.org/basemap 21 . 



SCIENTIFIC REPORTS | 3 : 1720 | DOI: 1 0.1 038/srep01 720 



2 




1890 1900 1910 1920 1930 1940 1950 1960 1970 1980 1990 2000 2010 

Year 

Figure 3 | Culturomics of physics enables a quantitative analysis of the trends of scientific discovery. The Physical Review published its first publication 
in July 1893. Almost 24 years later, in May 1917, the word "quantum" is first mentioned in the title of the paper by E. M. Terry, Phys. Rev. 9, 393. The 
popularity of the word rises fast and peaks in January 1927 at /= 0.33, but then starts declining almost as fast as it rose. An upward momentum is picked 
up again during the 70s, which continues till today. By quantifying the upward and downward trends by means of piecewise linear fitting of the moving 
average, we can identify the starting points of periods of duration w = 2, 4, 8 and 16 years during which the trends were the strongest. 



Ranking the countries according to their overall average monthly 
production during the last 20 years yields US, Germany, France, 
UK, Japan, Italy, China, Russia, Spain, Canada and Netherlands, 
while per capita yields Switzerland, Israel, Denmark, Sweden, 
Slovenia, Finland, Germany, Netherlands, France and Austria as 
the top 10, respectively. These results are in good agreement with 
more comprehensive rankings that were recently published based on 
World citation and collaboration networks over many different fields 
of research 19 . Our goal here is solely to provide a general overview of 
the geographical origin of the data, and so we proceed with the core 
analysis of trends of physics discovery. 

To do so, we employ the methodology described in the Methods 
section. Results for the word "quantum" are presented in Fig. 3 (the 
n-gram viewer for publications of the American Physical Society is 
available at matjazperc.com/aps), where the vertical lines denote the 
starting times of windows during which the maximal upward and 
downward trends were recorded. By performing the same analysis on 
the whole data set and ranking the trends in a decreasing manner (we 
use absolute values for negative slopes x), we arrive at the biggest ever 
upward and downward movers across the whole publishing history 
of the American Physical Society. Since the obtained tables are too 



big to be displayed meaningfully in print, we make them available 
online at matjazperc.com/aps/rankings, separately for all time win- 
dows w and eligible journals. The Physical Review ST: Physics 
Education Research and Physical Review X (PRX) do not have an 
extensive enough publication history to qualify for this analysis. 
Although it would be interesting to comment on the trends of par- 
ticular words and phrases and reconcile them with other historical 
accounts, the options for how to do that are simply too many to be 
meaningfully covered in this publication. We hope readers will find 
their favourites amongst the trendsetters and conduct experiments of 
their own. Here we proceed with the focus on the large-scale prop- 
erties of the trends. 

As Fig. 4 demonstrates, the distributions of magnitude have heavy 
tails, largely independent of the direction of trend and journal. 
Nevertheless, subtle differences can be inferred, and they deserve 
special attention. To determine the properties of the depicted dis- 
tributions more accurately, we test several hypotheses. The first is 
that the depicted cumulative distributions follow a power law P(x) oc 
(x/x min )~ a+1 . By using maximum-likelihood fitting methods and 
goodness-of-fit tests based on the Kolmogorov-Smirnov statistics 22 , 
we find that only for the journals depicted bold in the legend of Fig. 4 




Magnitude of downward trend Magnitude of upward trend 



Figure 4 | Heavy tails in the distributions of upward and downward trends indicate that the trendsetters in physics are few but strong. The large 
majority of words and phrases will never reach widespread use. Depicted is the probability that the magnitude of the downward (A) and upward (B) trend 
will be at least that displayed horizontally. For journals denoted bold the power law gives an acceptable fit to the data (see Table I for details). 
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Table I | Characterization of the distribution of the magnitude of 
trends reveals that for the majority the power law is an acceptable 
hypothesis. Journals for which both the upward and downward 
trends follow a power law are denoted bold. We use p > 0. 1 as 
the threshold for acceptance 22 . The distributions of downward 
trends for PR and PRI are described best by a power law with 
an exponential cut-off having (a = 1.91, X = 69.1) and (a = 
0.88, X = 1 1 3.2), respectively, while the distribution of upward 
trends for PRE is a stretched exponential with (/? = 0.62, X = 
121 .3). For the distribution of upward trends for the Reviews of 
Modern Physics (RMP) and for both distributions concerning 
Physical Review ST: Accelerators and Beams (PRSTAB), none of 
the five considered functions, including the exponential and log- 
normal in addition to the three already mentioned, provide an 
acceptable fit 
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the power law is an acceptable fit. The distributions of downward 
trends for the Physical Review (PR) and Physical Review Series I 
(PRI) are best described by a power law with an exponential cut- 
off P(x) oc x~ a+1 exp(-Xx), while the distribution of upward trends 
for the Physical Review E (PRE) is a stretched exponential P(x) oc 
x li ~ x exp( — Xx p ). The pertaining exponents are summarized in 
Table I. 

Although distributions depicted in Fig. 4 are not the most beautiful 
power laws, and some altogether fail to conform to the power-law 
hypothesis, the prevalence of heavy tails nevertheless hints firmly 
towards robust large-scale self-organization governing the up and 

down trends. By defining the trend rate as r(f) = where At is 
the smallest time interval between two consecutive trajectory points, 
we can directly test for the Matthew effect. However, since the tra- 
jectories exhibit both up and down trends, we determine the upward 
and downward rates separately within time windows of maximal 
growth and decline. Results presented in Fig. 5 confirm that the more 
commonly used a given word or a phrase is, the larger its expected 
upward momentum is going to be. The same holds true for 
the magnitude of falls during times of decline. Together with the 
continuity of scientific progress, the Matthew effect gives rise to 
strong but rare trendsetters on the expense of the majority of discov- 
eries that remain forever unknown except to those that made it. 

Discussion 

The model of growth and preferential attachment 6 captures the 
essence of our observations. Attachment rates that are linearly pro- 
portional with the degree of each node translate into power-law 
distributions, while deviations from the linear form lead to deviations 
in the corresponding distributions. Near-linear attachment rates 
yield log- normal distributions 4 , while sublinear attachment rates 
yield distributions with an exponential cut-off or stretched exponen- 
tial distributions 23 ' 24 , depending further on the details of sublinearity. 
The accuracy of empirical studies will also be impaired by finite-size 
effects and saturation, which may additionally contribute to devia- 
tions from the power law 25 . By contrasting the distributions in Fig. 4 
with the corresponding rates depicted in Fig. 5, we find an agreement 
that is well aligned with the theoretical expectations. Moreover, hav- 
ing a closer look at the journals for which the deviations from the 
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Figure 5 | Linear upward and downward rates indicate that the rise and fall of scientific paradigms is governed by robust principles of self- 
organization. The more a topic is popular, the more popular it is likely to become. Vice versa, during times of decline the fall is going to be the stronger the 
larger the popularity. (A) Rates per year averaged over top 1000 words and phrases for journals denoted bold, for which the distribution of both upward 
and downward trends follows a power law. Beyond /« 0. 1 saturation effects give rise to stronger deviations from the linear form. (B) Rates per year for the 
remaining journals, for which either the upward or downward trends or both are not satisfactory described by a power law. Deviations from linear rates 
translate directly to deviations from the power law in the corresponding cumulative distributions depicted in Fig. 4. 
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linear rates are particularly strong, we find either that they were 
published in a time when abstracts were rare (PRI, partly also PR), 
that their publication history is relatively short (PRE, PRSTAB), or 
that they publish reviews rather than original research (RMP), all of 
which are probable causes for the analysis on this particular cases to 
give less conclusive results. 

The identified self- organization in the rise and fall of scientific 
paradigms can be seen akin to previous reports of preferential attach- 
ment in citation rates and the acquisition of scientific collaborators 4,5 . 
Specifically related to the former case, our discovery can be inter- 
preted as the textual extension of the Matthew effect in citation rates 
or as the large-scale "semantic" version of that effect. It is also worth 
noting that, although it is debatable whether the concept of preferen- 
tial attachment is based on luck or reason 26 , in our case at least it 
seems inevitably due to the actual progress made, not chance that 
could make one discovery seem bigger than it truly is. 

Methods 

After identifying all unique words and phrases, we determine their relative frequency 
of occurrence /with respect to the number of publications in any given month for 
each journal published by the American Physical Society as well as overall. We 
consider a phrase to be a string of words separated by a space, and we limit our 
analysis to at most four-word phrases to keep the volume of information to be 
processed manageable. By ignoring capitalization, numbers, words containing 
numbers, and formulae, we identify 1 18056 single words, 3269090 two- word phrases, 
13295156 three-word phrases, and 23799449 four-word phrases, thus obtaining over 
40 million trajectories that enable a qualitative exploration of the trends of physics 
discovery. While of course not all identified words and phrases have to do with 
physics, the assumption we make is that only those that do will actually exhibit 
notable trends. Words like "the" or "of appear in nearly every abstract. The word 
"quantum", on the other hand, is mentioned first in the 1917 May issue of the 
Physical Review, with popularity subsequently peaking in January 1927 at/= 0.33, as 
depicted in Fig. 3. Trajectories of all other words and phrases can be searched for and 
viewed at matjazperc.com/aps. 

However, since not all publications of the American Physical Society have an 
abstract, and since some abstracts are very short, even the most common words and 
phrases can occasionally exhibit relatively strong trends. Not to treat those trends as 
trends of physics discovery, we eliminate from the analysis the most common English 
words as identified in 27 , minus a few hand-picked special cases that obviously have to 
do with physics. We also eliminate phrases that contain the most common English 
words either at the beginning or end. With these two additional filters in place, we 
make sure that from all the identified unique words and phrases the focus is on those 
that, in the majority of cases, concern at least some aspect of physics. 

To quantify the trends, we seek out time windows where the slope x of the linear fit 
of each trajectory is maximally positive and maximally negative, and we do so 
separately for windows of width w = 2, 4, 8 and 16 years. The dispersal in years is 
important as we want our analysis to encompass short-, mid- and long-term trends. 
Although a straight line won't be a good fit for the data in several cases, it is never- 
theless a useful first-order approximation for whether a subject is trending up or 
down, and to what extent this is the case 28 . Recent most advances on how to identify 
trends in word frequency dynamics are presented in 29 , and they shall be an excellent 
basis for future explorations. As starting points of each of the four considered time 
windows, we consider every month of every word and phrase for which data is 
available, with the obvious condition that the starting point plus the window width 
must not go beyond October 2012. Before the analysis we apply a 12 month moving 
average on the trajectories and require that the considered time windows must not 
contain missing data after averaging. Moreover, we dismiss all words and phrases 
with max \x\ < 0.001/year as lacking notable trends. 
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